Tachyonic perturbations in AdS 5 orbifolds 
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We show that scalar as well as vector and tensor metric perturbations in the Randall-Sundrum II 
braneworld allow normalizable tachyonic modes, i.e., possible instabilities. These instabilities require 
nonvanishing initial anisotropic stresses on the brane. We show with a specific example that within 
the Randall-Sundrum II model, even though the tachyonic modes are excited, no instability develops. 
We argue, however, that in the cosmological context instabilities might in principle be present. We 
conjecture that the tachyonic modes are due to the singularity of the orbifold construction. We 
illustrate this with a simple but explicit toy model. 
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I. INTRODUCTION 

Already at the beginning of the last century, the idea 
that our universe may have more than three spatial di- 
mensions has been explored by Nordstrom JjJ , Kaluza Q 
and Klein jj) . Since superstring theory, the most promis- 
ing candidate for a theory of quantum gravity, is consis- 
tent only in ten space-time dimensions (11 dimensions 
for M-theory) these ideas have been revived in recent 
years It has also been found that string theories 

naturally predict lower dimensional "branes" to which 
fcrmions and gauge particles are confined, while gravi- 
tons (and the dilaton) propagate in the bulk ■ 

Recently it has been emphasized that relatively large 
extra-dimensions (with typical length L ~ fim) can 
"solve" the hierarchy problem: The effective four-dimen- 
sional Newton constant given by G4 ~ G/L n can become 
very small even if the fundamental gravitational constant 
G ~ m~( 2+n ' ) is of the order of the electroweak scale ]To| 
Here n denotes the number of extra dimensions. It 
has also been shown that extra dimensions may even be 
infinite if the geometry contains a so-called "warp fac- 
tor" . An especially attractive model of this type, where 
the bulk is a five-dimensional anti-de Sitter (AdS ) space 
has been developed by Randall and Sundrum H|. This 
is the model which we discuss in this work; we shall call 
it RSII in what follows. 

The size of the extra dimensions is constrained by the 
requirement of recovering usual four-dimensional New- 
ton's law on the brane, at least on scales tested by ex- 
periments Jl5|— |l7[| . 

Models with finite extra dimensions always have to in- 
voke some nongravitational interaction in order to sta- 
bilize the graviscalar (which is equivalent to the ra- 
dion) JR| |. However, in the case of noncompact warped 
extra dimensions, it can happen that this mode is not 
normalizable and therefore cannot be excited. This is 
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precisely what happens in the RSII model. 

Therefore, there is justified hope that, for suitable 
parameters, this model can reproduce four-dimensional 
gravity without invoking ad hoc additional interactions. 
However, we show in this paper that the gravitational 
sector coupled to a brane with nonvanishing anisotropic 
stresses does have negative mass modes. We argue that, 
on the linearized level, these instabilities are not relevant 
for the Randall-Sundrum model, but they may be dev- 
astating in the cosmological context where the brane is 
moving. 

The tachyonic modes are absent if there are no 
anisotropic stresses. Furthermore, if anisotropic stresses 
remain small, they cannot develop an instability. As we 
shall show, this is the case for the RSII model since 
there, to first order, anisotropic stresses evolve like in 
Minkowski space-time and hence remain small (if their 
Minkowski evolution is not already unstable). In the 
cosmological context, however, this is no longer true and 
large deviations from homogeneity and isotropy may in 
principle develop. 

The outline of the paper is as follows: In the next 
section, the perturbation theory on RSII is briefly intro- 
duced and the relevant perturbation equations are given. 
We present the solutions to the bulk perturbation equa- 
tions and the junction conditions for tensor, vector and 
scalar modes. We pay particular attention to the tachy- 
onic modes which are new and represent a possible insta- 
bility. In Section HI we discuss the simple case of free- 
streaming, relativistic particles and show that they in- 
duce negative mass modes. We explicitly solve the equa- 
tions for the RSII background and see that no instability 
is induced in this case. We then argue that, in principle, 
this behavior may change in a cosmological setting. 

In Sec. |v| , we present a simple 3 + 1 dimensional 
Minkowski orbifold who's bulk modes exhibit the same 
instability as the AdS 5 orbifold. We explicitly re- 
construct the instability from the retarded Green's func- 
tion, showing that it is causal. In this toy model, instabil- 
ities develop due to nonlinear couplings. A final section 
is devoted to some conclusions. 
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II. PERTURBATIONS OF THE RSII MODEL 

Our universe is considered to be a 3-brane embedded 
in five-dimensional anti-de Sitter space-time, 



ds = g AB dx A dx I 



!J 2 



-dt 2 + 5. l] dx l dx : > +dy 2 ] . (1) 



Capital Latin indices A, B run from to 4 and lower case 
Latin indices i,j from 1 to 3. Four-dimensional indices 
running from to 3 will be denoted by lower case Greek 
letters. Anti-de Sitter space-time is a solution of Ein- 
stein's equations with a negative cosmological constant 
A, 



G, 



kg a 



o . 



The curvature radius L is given by 
L 2 



6 
A 



(2) 



(3) 



In braneworld models one often uses Gaussian normal 
coordinates. For anti-de Sitter space these are given by 
the transformation L 2 /y 2 = exp (— 2g/L). The metric 
then takes the form 



ds 2 



g AB dx A dx B = er 2p/L (-dt 2 + 5 lj dx t dx j ) 



dp 2 



(4) 

We now introduce one single brane at y = yb = L (or 
equivalently p — 0) and replace the "left hand side" , < 
y < L, of AdS B by a second copy of the "right hand side" . 
We use the superscripts ">" and "<" for the bulk sides 
with y > yb and y < ybi respectively. In terms of the 
coordinate y, the value of y decreases continuously from 
oo to L and then jumps to — L over the brane whereafter 
it continues to decrease. At the brane position, y^ = 
L, y^ — — L, the metric function (L/y) 2 has a kink. The 
advantage of the coordinate p introduced in Eq. (^) is 
that the variable p does not jump, but the metric function 
in the presence of a brane becomes exp(— 2\p\/L). 

The Einstein equations at the brane position are sin- 
gular; they contain a Dirac-delta function. To avoid this, 
one can integrate them over the brane which leads to the 
so-called junction conditions p9|-p2| at the brane posi- 
tion. These read fl2l 



A" 



K.S, 



(5) 



where is the energy-momentum tensor on the brane 
with trace S, and 



= 67T 2 G, = 



1 



(6) 



M5 and G5 are the five-dimensional (fundamental) re- 
duced Planck mass and Newton constant, respectively. 
K^ v is the extrinsic curvature of the brane and is 
the induced metric on the brane. Equation ([5]) is usu- 
ally referred to as the second junction condition. The 



first junction condition simply states that the induced 
metric, the first fundamental form, 



(7) 



be continuous across the brane. Here the vectors e v are 
tangent to the brane. In more detail, if we parametrize 
the brane by coordinates (z M ) and its position in the bulk 
is given by functions (z M ), the vectors e v are defined 
by 



(8) 



Denoting the brane normal by n, we have g AB e A n B = 0. 
The extrinsic curvature can be expressed purely in 
terms of the internal brane coordinates |24, p5[, 



K 



K^ v dz v dz tl , with 



K„ v = -- [g AB (e A d u n B + e A d^n B ) + e A e B n c g AB , c ] . 

(9) 

In the case we are interested in, the background space- 
time consists of two copies of the part of AdS 5 with \y\ ^ 
\ijb\ = L. We actually let the coordinate y jump from 
y = L to y = —L across the brane. Since the metric 
is symmetric in y, the first junction condition is trivially 
fulfilled. The second fundamental form is proportional to 
the induced metric, K^ u = ±L~ 1 q lll/ , hence the energy- 
momentum tensor on the brane is a pure brane tension 
T, = -Tq^. With 



K> u - K< v = [K^] = 2K> U 
the second junction condition becomes 

2 1 



[Koo]\ Vb 



L 3 

2 1 T 

— = -K r T 

L 3 5 



(10) 

(11) 
(12) 



This leads to the well-known RS-fine-tuning condition, 

(13) 
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The most general perturbation of the AdS 5 metric (|l|) 
is of the form 

ds 2 — g AB dx A dx B 
1? 

= -o [-(1 + ^)dt 2 - A^dtdx 1 - ABdtdy 
V 

+ ((1 - 2$)% + ■2ll, ,n\.r'd.v + AEidx l dy 

+ (l + 2C)dy 2 ] . (14) 

Here Ej and !Bj are divergenceless vectors and Hij is 
a divergenceless, traceless tensor. It is easy to show 
that there exists one fully specified gauge in which the 
perturbation variables take this form; vectors have no 
"scalar component" and tensors have neither a vector nor 



3 



a scalar component. We call this the generalized longitu- 
dinal gauge (see also (2(| |27]] ) . We shall use it in the fol- 
lowing. Within linear perturbation theory, the variables 
with different spin, the tensor fly, the vectors and Si, 
and the scalars 'J, <&, £>, C do not couple. We can therefore 
study the perturbations of each type separately. We shall 
do so in the next subsections. There we write down the 
perturbed Einstein equations for a fixed Fourier-mode k 



for which we have k • £ = k • S = k l H;. 



0. We do not 



perform a Fourier decomposition in time. 

We want to study the perturbations in an empty bulk 
with possible perturbations on the brane. The five di- 
mensional Einstein equation implies the perturbation 
equations in the bulk, 

5G AB = -A5g AB , (15) 

and the junction conditions at the brane, 



28K. 



K 5 SS, 



ill) 



(16) 



We first discuss tensor perturbations. As we shall see, the 
homogeneous equations reduce to the same Bessel equa- 
tions for all three types of perturbations (see also p3). 



These are just the ordinary gravity modes of four- 
dimensional mass m without a mass gap which are dis- 
cussed in the original RS paper |l4[ . However, if Z = 
—m 2 is positive, the solutions take the form 



/ = exp(±t \jz - k 2 ) = exp(±faj) , (22 
K 2 (\m\y) , 



g = N(\m\yY x 



h{\m\y) . 



(23) 



Here K v and I v are the modified Bessel functions of order 
v. The second case g cx I 2 grows exponentially in y. 
This is not normalizable and therefore cannot represent 
a physical, small perturbation. However, the mode K 2 
decays exponentially and is normalizable and small for 
sufficiently small initial amplitudes. However, even with 
arbitrary small initial data this mode grows exponentially 
in time for sufficiently small wave numbers, k 2 < —m 2 ; 
it is a tachyonic instability. 

To have a complete solution to the perturbation equa- 
tions we need to discuss the boundary conditions at the 
brane, i.e., the junction conditions. 

A short computation shows that the nonvanishing com- 
ponents of the extrinsic curvature tensor perturbations 
are in our case 



A. Tensor perturbations 

In this paragraph we first discuss the simplest case, 
the tensor perturbation equations. We write them down 
for a fixed Fourier- mode k and determine their solutions. 



We consider only Hij 7^ 0. For this case, Eq. (|15| ) reduces 
to 



d 2 + k 2 - 8 2 + -d y ) = n 



(17) 



For a given polarization, H, = H + or H, = H x , we make 
the ansatz H, = f(t)g(y) leading to 



f 



(gj - %d y )g 
9 



(18) 



where Z is an arbitrary separation constant. The behav- 
ior of the solutions to these equations depends strongly 
on the sign of Z. If Z = —m 2 is negative, we obtain 



/ = exp(±it\/m 2 + k 2 ) = exp(±zwi) , (19) 
Ji{my) , 
Y 2 (my) . 



g = N(my) 2 x 



(20) 



Here J„ and Y„ denote the Bessel functions of order v. 
They are oscillating and decaying. They are "(^-function 
normalizable" perturbations like harmonic waves in flat 
space, in the sense that H m = fg satisfies |2q, |29[| 



dy i 
H rn H rn > — — cx mS(m — m) . (21) 



rn ±J -rn' 

o m "V 



§K U \ = I -H 



2(d y Hi 



(T) 



dyHij 



hence 



(24) 



where are tensor-type anisotropic stresses on the 

brane. 

Let us first consider the homogeneous case = 0. 
For m 2 > 0, the solutions are of the form 



H = exp(±zwi)(my) 2 [AJ 2 {my) + BY 2 (my)} 
The junction condition ( p4| ) then requires 
Ji(mL) 



B 



-A- 



Yi (mi) 



-(mL) 2 A 



(25) 



(26) 



where the last expression is a good approximation for 
mL <C 1 • This is precisely the result of Randall and Sun- 
drum [ p"4] |. This is not modified even if we allow for the 
negative mass modes, Z = — m 2 > 0, because a physical 
solution has to be of the form 



H = Cexp(±t^Z - k 2 )(\m\y) 2 K 2 (\m\y) 



(27) 



and since K\ has no zero, the junction condition ( |24| ) 
requires C = 0. 

But in a realistic brane universe, n^ T ' is not ex- 
actly zero. In cosmology, it is just typically a factor 
of 10 smaller than other perturbations of the energy- 
momentum tensor on the brane. We therefore can not 
set C = 0. However, as long as n( T ) remains small, we 
do not expect the unstable modes to be present; hence we 



expect C(k,m) = for k < 



In the next section, 
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we shall show in a specific example that this is indeed the 
case in RSII, where the brane is Minkowski space and to 
linear order the anisotropic stress follows its background 
equation of motion. In the cosmological context, how- 
ever, the evolution of Il( T ) contains H which then can in 
principle feed the instability. 

One may ask, whether the unstable K mode is a con- 
sequence of the thin brane limit. However, it is clear that 
in a thick brane, the kink of the K mode at the brane 
position will simply be replaced by a rapid but gradual 
transition. The important point is that the presence of 
the brane cuts off the inner part < y < L of AdSs 
on which the K mode would not be normalizable, and 
replaced it by a second copy of L < y < oo, rendering 
the K mode normalizable in the bulk. It is this orbifold 
contruction and not the limit of an infinitely thin brane 
which leads to the instability. 

It is interesting to note that the K mode decays ex- 
ponentially in y direction; it does not propagate into the 
bulk, but moves along the brane. However, due to its 
negative mass square, m 2 < 0, it is a tachyon and there- 
fore provokes an instability, and its amplitude grows ex- 
ponentially in time for sufficiently small wave numbers, 
k 2 < —m 2 . 

In Sec. [v] we discuss a toy model, where we see ex- 
plicitly how the exponential growth of H can trigger an 
exponential growth of quantity on the brane it couples 
to, when nonlinear effects are taken into account. In that 
sense it is not clear that the RSII model is safe from this 
instability once non-linear effects are taken into account. 

The discovery of these tachyonic "modes" 1 is already 
the main result of this work. In the next subsections we 
simply repeat our analysis for vector and scalar pertur- 
bations and show that exactly the same behavior is found 
there. 



B. Vector perturbation 



In this section we follow closely Ref. [[KJ where the 
problem of vector perturbations has been considered in 
the cosmological context. 

The bulk Einstein equations for a mode k of the vector 



1 Since the new "K modes" are not free, they have to vanish if 
anisotropic stresses are absent, they are not modes in the usual 
sense of the term: free solutions to some linear hyperbolic equa- 
tion. We shall nevertheless use this term here, committing a 
slight abuse of language. 



perturbations £ and 5 are 
3 



k 2 £ 



y 



k 2 )E 



U 



3^ 

I! , 



-0 t E , 



(28) 
(29) 
(30) 



where the spatial index on £ and 5 has been omitted. 
The constraint equation Eq. (|30| ) fixes the relative am- 
plitudes of £ and S, showing that there is only one inde- 
pendent vector perturbation in the bulk (the "gravipho- 
ton" ). One can check that these equations are consistent, 
e.g., with the master function approach of Ref. [|T). 

As in the tensor case, one can solve the equations with 
a separation ansatz. For a negative separation constant, 
Z = —m 2 < 0, one obtains the expected oscillatory 
modes, 



£ = exp(±iu>t)(my) 2 [AJ2(my) + BY2(my)] 



(31) 



77! 



■ exp(±jtt>t)(mj/) [AJi(my) + BYi(my)} , 



(32) 



where u> = \rm 



k 2 . These solutions have been found 
in Ref. []32|. For a positive separation constant Z = 
—m 2 > 0, we obtain again tachyonic solutions. Like 
in the tensor case, the solution containing the modified 
Bessel function l v cannot be accepted as it is exponen- 
tially growing and thus represents a non-normalizable 
perturbation. However, the -K^-solution is exponentially 
decaying and therefore perfectly acceptable. For tachy- 
onic vector perturbations with uj = V Z — k 2 we have 

£ = Cex^{±^t){\m\y) 2 K 2 {\m\y) , (33) 

5 = p^C eM±^)(\My) 2 Ki(\m\y) . (34) 
\m\ 

For large enough scales, — m 2 > k 2 , these solutions can 
grow exponentially. 

Again, the boundary conditions at the brane relate 
the perturbations to the brane energy-momentum ten- 
sor. For the energy-momentum tensor on the brane, the 
vector degrees of freedom are defined according to 



/ 2Vj 



jiv 1 



(35) 



where Vi and n 2 are divergence-free vectors fields and 



n 



(V) - 1 



[djU 



(V) 



The first junction condition 



simply requires that £ be continuous at the brane, which 
it is since the (modified) Bessel functions of even index 
are even functions. The second junction condition results 
in (for a detailed derivation, see p(i||) 

(36) 
(37) 
(38) 



(d t z + d y x)\ yb = K5 v , 



'27b 

d t V 



2 tt(^) 



k 2 n 



5 



The last equation follows from (|36l ) and ([37]) and the 
bulk equations of motion (p8|)-(j30|). It represents mo- 
mentum conservation on the brane, which is guaranteed 
as long we have vanishing energy flux off the brane and 
Z^-symmetry. 

Like for tensor perturbations, we first consider homo- 
geneous solutions, setting = V = 0. This requires 
S(|to|L) = 0, hence 



B 



-A 



Ji(mL) 
Y x {mL) 



for to > 



C = for m z < 



(39) 
(40) 



Equation ( pq ) is then identically satisfied. 

However, it seems more realistic to allow for a small but 
nonvanishing anisotropic stress contribution H^ v ' and 
corresponding vorticity V. In this case, again, solutions 
with C =/= may exist, and small initial data could lead 
to exponential growth like for tensor perturbations. 

Using the normalization condition ( pl| ) for the to = 
mode of the variable Say (this is the one which enters 
as dynamical variable in the perturbed action; see p3|), 
one finds that contrary to the tensor case, the vector zero- 
mode is not normalizable. Therefore, on the brane there 
is only the ordinary massless spin-2 graviton, but there 
are an infinity of massive spin-2 and spin-1 particles (the 
modes discussed here, with to ^ 0). 



C. Scalar perturbation 

We now discuss the most cumbersome, the scalar sec- 
tor. Scalar-type metric perturbations in the bulk are of 
the form 

L 2 

ds 2 = — + 2^)dt 2 - 4Bdtdy 

y 

+ (1 - 2^)5 ij dx i dx j + (1 + 2C)dy 2 } . (41) 

The bulk Einstein perturbation equations for the mode 
k become, after some manipulations and introducing the 
combination T = $ + 



$ - * = C , 



d v $ +(d y -^jC= -d t B , 



(42) 
(43) 

(44) 

(45) 



- (dy--)C = 3d 2 $ + fc 2 ($ + C) , ! 4(i i 

v \ v; 



W s ( <VI> - l -C ) k-B . 

■ 2<t>-C ( <h, -Z)B 



(47) 
(48) 



Clearly these equations are not all independent; 
Eqs. (47) and @) are identically satisfied if Eqs. (P^)- 
d46| ) are. The solutions are obtained as for tensor and 
vector perturbations. For a negative separation constant 
Z = —to 2 < 0, we obtain (u> — yjm 2 + k 2 ) 



T = exp(±iLut){my) 2 [A' J 2 (my) + B'Y 2 (my)] , (49) 

C = cxp(±iLut){my) 2 [AJ (my) + BY (my)\ , 
1 



$ = - exp(±iojt)(my) 2 [A' J 2 (my) + B'Y 2 (my) 
+AJ (my) + BY {my)\ , 



1 



* = -exp(±iujt)(my) 2 [A'J 2 (my) + B'Y 2 (my) 



B = 



-AJ (my) - BY (my)} , 

i ■ ^ 2 
i 7, 771, II 

y ■ exp(±iuit) [(A' - iA)Ji{my) 



2ui 

+(B'-3B)Y 1 (my)] , 

2 

A' = 3A ™ „ , B' = 35- 

771 + 2ClT 



m - 



2uj 2 



(50) 
(51) 
(52) 

(53) 
(54) 



For a positive separation constant, Z = —m 2 > 0, we 



find (ui = ^jZ-k 2 ) 



r 

c 



exp(±Lut)(\m\ y ) 2 C'K 2 {\m\y) 
exp(±u;t)(\m\ y ) 2 CKo(\m\ y ) , 
1 



(55) 
(56) 



$ = - exp(±^)(Hy) 2 [C'K 2 {\m\y) + CK (\m\y)} , 

(57) 



B 

C 



exp(±^)(|m|y) 2 [C K 2 {\m\y) - CK (\m\y)] , 

(58) 



3, ,2 



±\77i\ A y 
2^7 

-3C- 



exp(±wi)[C" + 3C]Ki{\m\y) , (59) 

771 1^ 

(60) 



2u 2 



where we have already used that the / mode is not nor- 
malizable and therefore cannot contribute. Like for vec- 
tor and tensor perturbations, we find again tachyonic 
solutions with m 2 < which represent an exponential 
instability for sufficiently small wave number k (large 
scales). 

Determining the boundary conditions via the first and 
second junction conditions now requires a bit more care. 
Since we have already fully specified our coordinate sys- 
tem by the adopted choice of perturbation variables, we 
must allow for brane bending. We cannot fix the brane 
at )/b = L, but we must allow for y^ = L + £ and 
y£ = — L — £, respectively. The antisymmetry y^ = —y^ 
is an expression of *Z 2 symmetry. The introduction of the 
new perturbation variable £(z fJl ) describing brane bend- 
ing affects the first and second fundamental forms. From 
Eq. (^), we obtain g M „ = to first order, which implies 
that <& and hence C, have to be continuous. At the 
brane position, the perturbed components of the extrin- 



6 



sic curvature 



arc 



5K 00 = 4 



$-3^ + 2- 
L 



L 

SK 0J = d 6 (O t £ - B) 



SK i:j = 



d y V -2d t B + d 2 £ 



~ (* - 3$ - 2 1 ) ,7„<I> 



(61) 
(62) 



<% + didjE . (63) 



For the energy-momentum tensor on the brane, we 
parametrize the 4 degrees of freedom according to 



the brane as massive particles. If the brane matter is un- 
perturbed, only oscillating m 2 > solutions are possible. 
However, if we allow for nonvanishing matter perturba- 
tions on the brane, we can have C ^ and the tachyonic 
modes m 2 < can appear exactly like in the tensor and 
vector sectors. 

It is not surprising that the same instability appears in 
the scalar, vector and tensor sectors, because all modes 
describe the same bulk particle, the five-dimensional 
graviton. 



S in/ 



P 

vj PS i:j 



n 



(S) 



Tq„ v , (64) HI- TACHYONIC MODES FROM FREELY 

PROPAGATING RELATIVISTIC PARTICLES 



where v, = d iV and u\p = fad, - §A<%) U^ s \ With 
Eqs. (|6l|)-(p3[), the second junction condition reads 

1 

T 



(2p + 3P) = [$-y + Ld t {d t £-2B) + Ld v y}\ yb 



—n^ - £ 



1 

T 



= [*-$ + Ldy$}\ yh 



(65) 
(66) 

(67) 

(68) 



Combining the time derivative of Eq. ( |66| ) with Eqs. (45), 
( |65| ) and ( p8|) , we obtain momentum conservation on the 
brane, 



d t v 



-AU^ + P . 



(69) 



Similar manipulations imply energy conservation on the 
brane, 



d t p = Av 



(70) 



Like for tensor and vector perturbations, we first 
look for solutions with vanishing brane matter. Setting 
= p = P = v = forbids brane bending, E = 0. 
Then Eq. @ implies B{mL) = 0, thus 



B' — 3B 



-(A' -3A) 



Ji (rnL) 
Y\ (mL) 



for m > 



(71) 



C + 3C = for m 2 < . (72) 
The other equations are satisfied if we require separately 
Ji (mL) 



Yi(mi) 
C = for m 2 < 



for m z > , (73) 
(74) 



Equations and (|7^) are of course equivalent. 

As for vector perturbations, the m = scalar mode is 
not normalizable. Like for tensor and vector perturba- 
tions, we have found "scalar gravitons" which appear on 



A. The Liouville equation in 4 dimensions 

As long as Z2 symmetry is satisfied, we expect free 
(collisionless) particles on the brane to move along brane 
geodesies. Their one-particle distribution function there- 
fore obeys the Liouville equation. Here we sketch a 
derivation of perturbation to the 4D Liouville equation. 
Many more details can be found, e.g., in (34) or [p5| . 

An ensemble of freely propagating particles on the 
brane is described by the Liouville equation, 







n^f) —V 1 rP-rP 



f = L X J = 



(75) 



Here / is the one-particle distribution function defined 
on the mass shell, 

P M = {(x»,p v ) I 9llv [x)^p v = -M 2 } , (76) 

which we parametrize by the 7 coordinates (x^^p 1 ). The 
energy p a is then determined via the mass-shell condition. 
The energy-momentum tensor of the particles is given by 



p o P P f 



(77) 



To maximize anisotropic stresses, we consider relativistic 
particles, M 2 = 0. In this case we obtain the simple 
relation 



p = -t ° = sp = t; 



(78) 



where p is the energy density and P the "pressure" of the 
collisionless particles. With respect to an orthonormal 
frame we parametrize the particle momentum p l = pn l 
and define the "brightness" 



M 



Ana 4 



dpp 3 f 



(79) 



Here a is the cosmic scale factor which we can simply set 
to a = 1 in the case of a nonexpanding background. The 
components of the energy-momentum tensor are then 
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given by integrals over the momentum directions n. The 
anisotropic stress is 



n, 



1 



47T0 4 



dil I riiUj 



(80) 



Let us first consider tensor perturbations of the metric. 
Then, the Liouville equation ([75j) for the spatial Fourier 
transform of M becomes, to first order in the metric 
perturbations, fl34| 



M [T) +ikfiM {T) = -Aa 4 Pn l n j H tj , 



(81) 



where /i = k • n is the direction cosine between k and n, 
k = k/fc. The overdot denotes the derivative with respect 
to conformal time on the brane, r\. We now choose the 
coordinate system so that k is in 3-direction and (6, ip) 
denote the usual polar angles with /i = cos(0). In order 
to represent a pure tensor perturbation, MS T > must be 
of the form 

M (T HKn, v ) = (1 -/i 2 ) [M + (k,n, 77)008(2^) 

+M x {k,n,r)) sin(2<^)] . (82) 

Usingthis ansatz, the two modes of Hij decouple and 
Eq. (pi]) reduces to 



M.+ikixM. = -4a 4 PH. 



(83) 



where "•" stands for "x" or "+". Decomposing the 
tensor-type anisotropic stress into the two standard he- 
licitics + and x , we obtain 



n (T) = 

8a 4 



dfx(l- ^yM.(k,fi,r]) 



(84) 



For vector perturbations one finds, correspondingly 

M {v) + ikfiM (v) = -ia^PikfJ, (n ■ 53) , (85) 

where Ej is the perturbation of g^i [corresponding to our 
vector perturbation in Eq. ( f[4"| ) at fixed y]. Using the 
coordinate system where k points in the third axis, 
must be of the following form to represent a pure vector 
perturbation, 



M {v) (k,n, v ) = y/l-i**[Mi(k,iJt,ri)caa(<p) 

+M 2 (k,u,r)) sm(ip)] . (86) 

Again, with this ansatz the equations for the two hclici- 
ties decouple into 



M. + ikjj,M. = —4a PikfjiS, 



(87) 



and the components of the anisotropic stress potential 
n!^ are given by 



= — 

2a 4 



dfi(l - fi 2 )fiM.(k, fj,,ri) . 



Finally, for scalar perturbations of the metric, which 
are given by the Bardeen potentials, 'J'b and $b which 
are the longitudinal perturbations of the induced metric 
q^ v on the brane, one finds 



M (s) + ikiiM [s) = -Aa 4 Pikn ($ b + $ b ) 



(89) 



To represent a pure scalar mode, M^ s ' must be indepen- 
dent of the polar angle <p. The anisotropic stress potential 
is thus given by 



= — 

4a 4 



]pf dp(±-i/)MW(k,iA,rj) . (90) 



B. Solution in the RSII model 

In the RSII model, the brane is Minkowski space-time. 
We therefore can simply fix a — 1 and conformal time 
is identical to physical time, r\ = t. Furthermore, there 
is no matter in the background so that the functions M. 
and the pressure P are both of first order. Therefore, 
the right-hand sides of the perturbation Eqs. (|Sl|), (S3) 
and ( p9| ) are of second order and have to be dropped in a 
consistent first order treatment. The solution is therefore 
of the same form in all cases, 



M — F{k, /i, ip) exp(— ikixt) 



(91) 



Before we determine the prefactor F, and the resulting 
anisotropic stress , we Fourier transform M. with re- 
spect to time. This yields 



M(k, (j,, ip, w) = F(k, fi, (p)5(u> — kfj,) 
For tensor perturbations, 



(92) 



F(k, fi, <p) = (l- /i 2 ) [M+{», k) cos(2(^) 

+M x (fi,k) sm{2 V )} , (93) 




^M.{oj/k,k) (1 



for uo 2 < k 2 , 
else . 



, (94) 

Comparing this with Eq. ( |24| ) and using uj 2 — k 2 + m 2 , 
we find that only modes with —k 2 ^ m 2 < are excited 
and 



C.(m 2 ,fc) 



-3k 5 



16 " V k 

if- k 2 C m 2 < 



L 2 /c 4 iCi(|m|L) 



C.(m 2 ,fc) = else. 



Nevertheless, u> — Vk 2 + m 2 6 



(95) 

I, so that only oscillating 



and no growing modes are excited. 

Physically this result is not surprising. The distri- 
bution function of relativistic particles cannot change 
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faster than with the speed of light and hence modes with 
frequencies u) > k cannot be excited. Therefore, only 
the tachyonic modes are relevant. However, since II is 
not unstable, there is no instability. Only modes with 
k 2 — m 2 , and hence u> € K are excited. We expect 
this to hold true whenever the temporal change in the 
perturbations is due to the motion of particles. 

For vector and scalar perturbations, one obtains simi- 
lar results. For vector perturbations, we have 



n 



(V) _ 



=£M.(u/k,k)(l-!j£\% forcj 2 <£; 2 



else 



and for scalar perturbations 



(96) 



U (S) = { \M^ s \Lo/k, k) (i - for uj 2 < k 2 , 

\ else . 

The detailed junction conditions are somewhat in- 
volved, but they evidently imply again that only the 
modes with uj 2 < k 2 are excited, 



C. ^ only if - k 2 < m 2 . 



(98) 



Hence only tachyonic modes, m 2 < with lu £ K are 
present. But, since the distribution function M. does not 
grow exponentially in time, truly unstable modes with 
uj 2 = k 2 + m 2 < are not allowed. 

This example is interesting in the sense that the new 
tachyonic modes play an important role, but no instabil- 
ity develops. 



C. Comments about cosmology 

In a cosmological setup, we assume the brane to move 
in AdS 5 . The scale factor is then given by a = L/yb(rj), 
where 77 is conformal time on the brane. The cosmological 
equations for the unperturbed case are well known (see 
e.g., M), 



«4 2 (-. 



—) 

277 



p + m( P + p) = , 



(99) 
(100) 



with K5T = 6/i and K4 = K5/L. At low energy, p«T 
or TL <C a/L, we recover the standard Fricdmann equa- 
tions. 

Brane motion significantly alters the junction condi- 
tion. For instance, the perturbed junction condition for 
tensor perturbations (|24|) becomes 



LHd t H. 



LH 

a 



-, 1/2 



K-, 



8 y H. = -^a 2 II. , (101) 



where t and y denote bulk coordinates. Clearly, H.(t,y) 
is no longer separable and we have to rely on numerical 



simulations for its determination (see (3^, [37| for recent 
works on the homogeneous case, n. =0). 

In a cosmology dominated by relativistic collisionless 
particles, metric perturbations enter in the first order 
perturbation Eq. (|33"|), since P — p/3 is now a back- 
ground quantity. Hence n. and H, must be determined 
simultaneously via Eqs. (83), (|84) and (101). It is not 
yet clear to us whether an instabi ity may develop in the 
presence of anisotropic stresses. A detailed study is in 
preparation p8|. 



IV. A SIMPLE ORBIFOLD MODEL 
A. The toy model 

In Sec. II we have found exponentially growing per- 
turbations in the scalar, vector and tensor sectors of a 
RSII background. These can be generated from small, 
everywhere regular initial data. To complete the discus- 
sion, we have to specify a brane equation of motion for 
the anisotropic stresses and solve the full system. In the 
previous section we have shown that in the RSII model 
linear perturbations are still stable, but in a cosmologi- 
cal context, the coupling to metric perturbations might 
induce an instability. Here we present, instead, a sim- 
ple toy model, to show that nonlinearities can lead to 
instabilities already if the brane is flat Minkowski space. 

We want to show the following: The instability which 
we have found is not due to an instability in the equation 
of motion of the anisotropic stresses on the brane nor to 
an instability of the bulk in absence of a brane. It is 
also not coming from the choice of the wrong boundary 
conditions (incoming wave, advanced instead of retarded 
solution, etc. ), but it is due entirely to the singular 
orbifold construction used in RSII. 

Only the fact that we have two copies of y ^ ?/b renders 
the K mode normalizable, which would otherwise diverge 
exponentially for y — > 0. In the same way one obtains 
an instability if one glues together twice the same half 
of a simple Minkowski space. To see this we consider 
four-dimensional Minkowski space-time, with orbifoldlike 
spatial sections which can be identified with two copies 
of z 0. The 2 + 1 dimensional "brane" is represented 
by the plane z = and the "bulk" by two copies of z > 0. 

We consider a bulk field <j)(t, X11, z), which satisfies the 
ordinary hyperbolic wave equation, 



□^-(d 2 - An -d 2 







(102) 



Here X|| = (x, y) are the coordinates parallel to the 
"brane" and A|| — d 2 + d 2 . Like for the metric in RSII, 
we require <fi to be continuous across the brane (2 = 0), 
but it may have a kink, i.e., its derivative may jump. 
Confined on the brane is a field n which is given by 



lim d z d> = n 



(103) 
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Finally, we specify the equation of motion for II on the 
brane (the matter equation): 



(d t 2 -A||)n = - 




(104) 



where (9 M ) = (d t ,d x ,d y ) is the gradient on the brane. 

This resembles a "covariant derivative" with d^ip/cj) 
playing the role of the Christoffel symbols. 



From the brane point of view, <fi is now a tachyonic 
field with m 2 = —uJ 2 — p| < 0. In the pure brane model 
(without a bulk) this solution would therefore not appear. 
It is clearly only due to the orbifold construction. Since 4» 
decays exponentially away from the brane, this solution 
also does not describe an ingoing wave. 

C. Green's function approach 



B. Stable and unstable modes 

We first show that, if we do not allow for any "singular- 
ity", i.e., all fields and their first and second derivatives 
have to be continuous everywhere, this system has no 
instability. 

In this case, the fundamental solutions are simply 



6o exp [±i(Lut — p • x)] 



c^-p 2 







(105) 



with x = (x,y,z) = (x\\,z) and p = (p x ,p y ,p z ) 
(p\\,p±)- From Eq. ( |103| ) we obtain 



II = z f'ip±4'o exp [±i(u>t — p|| ■ X|| 



(106) 



It is easy to veri fy th at this is compatible with the equa- 
tion of motion ( |l04| ) for II. Clearly, these solutions do 
not exhibit any instability. They do not grow, but os- 
cillate in time. For an observer confined to the brane, <f> 
appears as a field with mass m 2 = p\ ^ 0. For p\ = m 2 
fixed, this system can be seen as a system of two fields 
II, (j) m on the brane, satisfying 

(8 2 - A,,)0 m = m 2 </> m , (107) 



and Eq. (104). This corresponds to a stable system of 
scalar fields on the brane. 

Now we proceed to the orbifold construction. We re- 
quire Z2 symmetry, 4>{—z) — (f>(z), but allow d z (f) to jump 
at z = 0. All the equations of motion remain the same. 
Now, the previous solutions for 4> have to be combined 
into Z2-symmetric linear combinations, 

4> = 4>o exp [±i(cot — p • x)] + (f>o exp [±i(cot — p • x)] , 

(108) 

where p = (py,— P±) if p = (pihPx)- Such solutions are 
still regular (continuous derivatives) at z = 0. However, 
there now appears a new set of solutions: 



<j) = cf>o exp [cot — ipii • X|| — k\ 
II = —k(f>o exp \tut — ipii • X||] 
with uj 2 = k 2 - p 2 , k > . 



(109) 
(110) 
(111) 



For k 2 > p 2 , we have to 2 > and can thus choose u> > 0, 
so that these solutions grow expone ntia lly in time. Evi- 
dently, <fi obeys the bulk wave Eq. (102) and II satisfies 
its equation of motion (104). 



We finally want to address the question whether this 
solution may contain "a-causal" contributions; or, more 
formally, whether it can be constructed from the retarded 
Green's function alone. 

We choose as Green's function for 6 the one with 



x = (t,x,y,z) , 
□G(x;x') = 5 (4) (x-x') , 
cVG(x,x') |^ = o = 0. 



Then, Green's formula gives (see, e.g., |39[) 



(112) 
(113) 



0(x) = / dfdxf, [5 z ,G(x,x')^(x') - G(x,x')^(x')] . 

Jz'=0 

(H4) 

Using the boundary conditions at z = for G and 0, this 
yields 

0( x )=-/" d*'dx||G(x,x')n(i',x||) . (115) 

Jz'=0 

The analogous expression for the RSII model is given 



in 1 40 



We now construct the reta rded Green's function obey- 
ing the boundary condition (113). We perform a Fourier 
transform in t' and xj, so that (112) becomes 



(u 2 - pf + d 2 ,) G(z; z') = 6(z - z') . (116) 



The boundary condition (113) is satisfied by the modes 
1 



u q (z) 



V2 



222 
q =uj -p.. 



(117) 



With the correct normalization (see, e.g., 40 ), we obtain 
the retarded Green's function 

If 00 , . . . f dujd 2 pu 

G (x jX ')Uo = -/ o M^ + ^j^ 

e -iuj(t-i')+iP||-(x||-X||) 



q 2 + p 2 — (oj + ie) 2 



(2tt) 4 p 2 - (w + ie) 2 
9{t - t')5 (t-t'-^ + lxn-xj,! 2 ) 

x 1 , (118) 

(27r),/^ + | X ||-x'P 
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where 9 is the Heaviside function, 



6(x) 



1 if x > , 
if x < . 



Up to a factor 2 which is due to 1i symmetry, this is 
just the standard retarded Green's function of the four- 
dimensional wave equation. 

In order to show that our unstable solution ( |109| ) does 
not invoke any a-causalities, i.e., contributions from an 
advanced Green's function, we now show that it can be 



obtained from the retarded Green's function (118) by 
means of Eq. (115). We perform the calculations for 



z > and then invoke Z 2 symmetry for z < 0. Equa- 
tions (11C) and (115) imply 



0(i,X||,z) = fc0 o 



dt'd 2 x!,, e "*'-*Pii- x j| 



2tt V*z 2 + r 2 
d(t-t'- Vz 2 + r 2 ) , 



e(t-t') 



(119) 



where r = xy — xj,. With d 2 X|| = d 2 r = rdrdip, integra- 
tion over t' and tp finally gives 



</>(*, xy, z) = fc^ e 



cjt— ipy -xii 



jy/ z 2 -\-r 



^z 2 + 



ut—ipn -xy 



■Jb(|P|||r) 
(120) 



Here Jq is the Bessel function of order 0. For the last 



equal sign we used the inte gral No. 6.645.2 in 41 . This 



proves that </> from Eq. ( |109| ) is a purely retarded solution 
and hence represents a true physical instability of the 
system. 



stable. Nevertheless, we have given an example where 
the new tachyonic modes play a crucial role. In the cos- 
mological context, the situation is significantly different 
and tachyonic modes could in principle lead to instabili- 
ties. Since metric perturbations are no longer separable, 
we have to rely on numerical simulations. We do not yet 
know whether an instability may develop in the presence 
of anisotropic stresses. A more detailed study will be 
presented elsewhere p8[ . 

Within a toy model, we have shown that the exponen- 
tially growing bulk modes do not come from an instability 
of the brane equations of motion or from the use of an 
inadequate Green's function, but are due to the singular 
orbifold construction. As we show explicitly in our toy 
model, the unstable modes can be obtained using the re- 
tarded Green's function. The toy model also shows that, 
taking into account nonlinearities, even a flat Minkowski- 
space brane can become unstable. 

Starting with small regular initial data on some hyper- 
surface of constant time, an exponential instability can 
build up in an AdS 5 orbifold. It remains to be examined 
whether this instability stays exponential also in the cos- 
mological context of a brane moving through AdS 5 , or 
if it disappears in an expanding universe like the Jeans 
instability of Newtonian gravity. This question is of ut- 
termost importance. If exponentially unstable modes are 
generated either on the first or second order, this will 
inhibit the realization of cosmology in terms of a RSII 
braneworld. 

One may then go even further and ask whether such 
orbifold constructions may not lead to instabilities in a 
much broader sense than what has been discussed here. 



V. CONCLUSIONS 

We have shown that the perturbation equations of the 
RSII model allow for tachyonic modes which can be ex- 
ponentially unstable. We have then argued that, within 
first order perturbation theory, the RSII model remains 
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